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Abstract 

The main purpose of this paper is to review the progress that has taken place so far in the 
search for a single unifying principle that harmonizes (i) the wave and particle natures of matter 
and radiation, both at the quantum and the classical levels, on the one hand and (ii) the clas¬ 
sical and quantum theories of matter and radiation on the other hand. In the author’s opinion, 
the Koopman-von Neumann-Sudarshan (KvNS) Hilbert space theory based on complex wave 
functions underlying particle trajectories in classical phase space, is an important step forward 
in that direction. To appreciate the similarities and differences between classical and quantum 
wave functions, it is important first to review the famous paradoxes of quantum theory arising 
mainly from the dual character of matter and radiation and the mysterious nature of measure¬ 
ments in quantum theory. They have given rise to the suspicion that quantum mechanics is 
an incomplete theory and to multiple interpretations of quantum mechanics as well as no-go 
theorems ruling out certain types of hidden variable theories introduced to ‘complete’ quantum 
mechanics in some way. It is also important to point out that experimental verifications of 
the predictions of the double-prism experiment and the observation of average single photon 
trajectories in weak measurements appear to favour the spacetime picture of particles favoured 
by Einstein, de Broglie and Bohm over the complementarity approach favoured by Bohr. The 
KvN theory of classical mechanics provides a clear and beautiful harmony of classical waves 
and particles. Sudarshan has given an alternative but equivalent formulation that shows that 
classical mechanics can be regarded as a quantum theory with essentially hidden noncommuting 
variables. An extension of KvNS theory to classical electrodynamics provides a sound Hilbert 
space foundation to it and satisfactorily accounts for entanglement and Bell-CHSH-like viola¬ 
tions already observed in classical polarization optics. An important new insight that has been 
obtained through these developments is that entanglement and Bell-like inequality violations 
are neither unique signatures of quantumness nor of non-locality—they are rather signatures of 
non-separability. Another new insight is the interpretation of the Wigner function as a KvNS 
wave function, i.e. a probability amplitude which need not be positive everywhere. This has 
important implications for simulating certain types of quantum information processes using clas¬ 
sical polarization optics. Finally, Sudarshan’s proposed solution to the measurement problem 
using KvNS theory for the measuring apparatus is sketched to show to what extent wave and 
particles can be harmonized in quantum theory. 
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1 Introduction 

The nature of the wave function in quantum mechanics has been debated from the the very beginning. 
Paradoxes like wave-particle duality, the mystery of quantum measurements and conundrums such 
as non-locality, have spawned a plethora of interpretations of quantum mechanics pQ and led to the 
belief that wave functions are special to quantum mechanics. Wave functions span a Hilbert space, 
and generations of text books have given rise to the belief that wave functions and Hilbert spaces 
occur only in quantum physics. One of the main purposes of this paper is to show that they can be 
introduced also in classical physics. In fact, this was done way back in the early 1930s by Koopman 
[2] and von Neumann [3], and later by Sudarshan [I] who had a different but equivalent approach. 
Koopman showed that the phase space of a classical mechanical system can be converted into a Hilbert 
space by postulating a scalar product which is an integration rule over the points of the phase space. 
This inspired von Neumann to apply the formalism to the ergodic problem. The dynamics in phase 
space is described by a classical probability density constructed from an underlying wave function- 
the Koopman-von Neumann (KvN) wave function. This is analogous to the Born rule in quantum 
mechanics. In the KvN framework, observables are represented by commuting self-adjoint operators 
acting on the Hilbert space of KvN wave functions, ensuring that all observables are simultaneously 
measurable. This is in contrast to quantum mechanics in which the hermitian operators representing 
observables need not all commute and cannot all be measured simultaneously with precision. A 
signihcant new dimension was added to the KvN theory by Sudarshan [3| who showed how classical 
mechanics can be embedded in quantum mechanics with essentially hidden variables^ and how a 
supers election rule operates to rule out transitions between classical states with different phases, 
thus causing decoherence. He further showed how KvNS theory provides the appropriate theoretical 
framework to solve the measurement problem in quantum theory. All this has led, in the author’s 
view, to significant progress towards the search for a unifying principle that harmonizes waves and 
particles as well as classical and quantum theories. 
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An unexpected recent discovery is that classical polarization optics displays quantum-like features 
such as entanglement, as originally predicted by Spreeuw [5] and independently by Ghose and Samal 
[6] . This is now an emerging held, and recent developments [3 El El EDI El El El El El El El El E] 
have been reviewed by Ghose and Mukherjee [JOj. Aiello and colleagues have developed a unihed 
theory for different kinds of light beams exhibiting classical entanglement and have indicated several 
possible extensions of the concept [21] • It has also been recently shown that the origin of such apparent 
quantumness in patently classical phenomena indeed lies in the KvNS Hilbert space structure of 
classical electrodynamics H. 

Another very signihcant result is the demonstration by Bondar and colleagues [231 ED that the 
Wigner function is proportional to the KvNS wave function which is a probability amplitude and 
need not be positive everywhere, thus solving the problem of its mysterious negative values in spite 
of being a probanility density. This makes it possible to use classical polarization optics to simulate 
certain types of quantum information processes. 

I will hrst briefly sketch the principal quantum paradoxes, interpretations of quantum mechanics 
and the no-go theorems, and then touch upon the epistemic versus ontic character of the quantum 
wave function before introducing wave functions in classical physics. This will enable the reader to see 
more clearly unexpected similarities between classical and quantum theories and help in identifying 
the real differences between them. In particular, it will become evident that entanglement and conse¬ 
quent violations of Bell-GHSH type inequalities are common features of classical optics and quantum 
mechanics, and that realism and separability are sufficient for the derivation of Bell’s theorem, not 
locality. I will then briefly refer to the violation of non-contextuality in classical polarization optics 
and its implications for classical realism. I will end with some remarks on the unity of waves and 
particles in the KvNS theory of classical mechanics, and sketch Sudarshan’s demonstration that the 
quantum measurement problem is solved by using a certain representation of KvNS theory for the 
classical measuring apparatus. 

It is assumed that the reader has a sound knowledge of the basics of classical and quantum 
mechanics and classical electrodynamics. 

2 Principal Quantum Paradoxes 

Wave-Particle Duality 

When a single particle state is incident on a double-slit, it produces an interference pattern on a 
distant plate when both slits are open, and a single-slit diffraction pattern when one of the slits is 
closed. There are two puzzles here: the hrst one is that an interference pattern is seen at all with 
‘particles’, and the second one is that this pattern disappears when one tries to hgure out which 
slit the particle actually went through. Heisenberg’s uncertainty principle AxAp > h/2 plays a key 
role here by ruling out precise particle trajectories between the source and the detector and also 
introducing untrollable disturbances in measurements that wash out the relative phases responsible 
for the interference pattern [25] . This is the essence of the paradox of wave-particle duality. This 
paradox has led to a number of interpretations ranging from particles or waves as expressed by 
Bohr in his complementarity principle [2S] through which way experiments [23 ESI E] and their 
interpretations in terms of partially particle-like and partially wave-like ‘information ’ [301 [33 [321E3] 
to fully particle and wave interpretations [SI El EE] and their tests [33 EE] . 

The double-prism experiment [35] to probe the nature of wave-particle duality differs from the 
others in that, instead of using interference as a signature of a wave-like property, it uses tunneling 
as the signature of a wave-like property on the one hand and anti-coincidence on a beam splitter of 
indivisible quanta as a signature of a particle-like property on the other hand. Quantum mechanics 
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Figure 1: The principle of the double-prism experiment proposed by Ghose, Home and Agarwal (Ref. [3S]). Single 
photons are incident from the left, and are either totally internally reflected to detector 1 or tunnels through to detector 
2. The two detectors are predicted to click in anticoincidence. 

predicts both tunneling and anti-coincidence of single photons (Fig. 1). Since every single photon 
is either reflected or transmitted, the same experimental set up exhibits both fully particle-like and 
fully wave-like characteristics, thus favouring the wave and particle interpretation over the wave or 
particle interpretation. 

In 2001 Cufaro-Petroni and Vigier [52] analyzed various single-neutron and single-photon experi¬ 
ments as well as their theoretical interpretations in terms of the de Broglie-Bohm theory and Nelson’s 
stochastic mechanics HOI. Vigier emphasized that though no conclusive argument could be reached, 
they seemed to favour Einstein’s and de Broglie’s realistic spacetime description of light in terms of 
particle trajectories. 

The Schrodinger Cat 

The cat paradox was introduced by Schrodinger in his 1935 paper HU on the status of the quantum 
theory. He showed that the uncertainties of the microscopic world (the uncertainty of the time of 
decay of a radioactive substance) can get transferred to a macroscopic object like a cat, resulting 
in a superposition of incompatible macroscopic states like ‘dead’ and ‘alive’ which are never seen. 
Interestingly, following the work of Leggett and his co-workers nasal HU, recent experiments have 
successfully created mesoscopic cat states using rf-SQUIDs [15] . 

The EPR Paradox 

In the same paper Schrodinger dwelt extensively with the idea of the non-separability of two 
quantum systems that are spatially separated and non-interacting, introduced by Einstein, Podolski 


4 










and Rosen |1B]. He coined the term ‘entanglement’ and argued that it is the characteristic feature of 
quantum mechanics that distinguishes it from classical physics. Entanglement is the loss of identity 
of individuals in a holistic entity, the entangled state. When a measurement is made on this holistic 
entity in a particular basis, it results in a ‘conditional disjunction’ of this entity by an obscure 
process outside the ambit of quantum theory. This leads to the EPR paradox and the incompleteness 
argument. The famous EPR paper was written by Podolski and, according to Einstein, the main 
point of the argument got obscured by pedantry. Einstein’s argument is very simple HU- Let Si and 
S 2 be two partial systems, and let 

^(^1^2) = CiV’i(^i)V’2(^2)+C2^2(^i)^i(^2) 

= C^i0l(*S'i)02(S'2) + C202 (*S'i)0i(S'2) (1) 

with |cip + |c 2 p = + |c 2 p = 1 be their wave function expressed in two incompatible bases. 

Such a wave function is non-separable in the sense that it is not expressible as the product of 
the individual wave functions of Si and 52. This results in Si and S 2 losing their individualities 
in the state T(5i52). It is in this sense that they become ‘non-separable’ or ‘entangled’. This is a 
straightforward consequence of the fact that quantum mechanical wave functions span Hilbert spaces. 

Einstein assumes that an experimenter is free to choose the basis in which a measurement is to 
be made on Si. Then it is clear that she would obtain different wave functions '0(52) or 0(52) for 
S 2 depending on her choice. Now, if one further assumes that (i) the ontic state of S 2 is not in any 
way influenced by what measurement is made on 5i (locality/separability assumption), and that (ii) 
every ontic state of a system is associated with a single wave function (a requirement of standard 
quantum theory), then there is a problem. One way to avoid this problem is to allow more than one 
wave function to be associated with a given ontic state of a system, i.e. to give up condition (ii). In 
this case the wave function may be called ‘epistemic’ (i.e. more than one wave function correspond 
to a given ontic state), and quantum mechanics is clearly an ‘incomplete’ description of nature. 
Einstein favoured this interpretation. The alternative is to avoid assumption (i), i.e. the assumption 
of locality/separability. The notions of locality and separability are, however, not identical-it is 
possible to have non-separability without non-locality, as we aill see later when discussing classical 
polarization optics. Einstein found both choices unacceptable. 

In the 1927 Solvay Conference Einstein had already sketched a simple argument to show that 
even in the case of a single particle, quantum mechanics was incompatible with locality and realism 
[38]. This was a precursor to Bell’s theorem |39]. Consider a single particle represented by a plane 
wave function incident on a screen with a small hole. On the other side of the hole, the wave function 
spreads out in the form of a spherical wave, and is hnally detected by a large hemispherical detector. 
This spherical wave obviously shows no preferred direction. Einstein observed: 

If 100 were simply regarded as the probability that at a certain point a given particle 
is found at a given time, it could happen that the same elementary process produces an 
action in two or several places on the screen. But the interpretation, according to which 
the I"00 expresses the probability that this particle is found at a given point, assumes an 
entirely peculiar mechanism of action at a distance, which prevents the wave continuously 
distributed in space from producing an action in two places on the screen. 

Einstein noted that this ‘entirely peculiar mechanism of action at a distance’ was in contradiction 
with the postulate of relativity 
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3 Interpretations of Quantum Mechanics 


Bohr 

As a result of these paradoxes, quantum mechanics has been riddled with interpretations of 
various kinds over the years. The hrst interpretation given by Niels Bohr was an epistemological one 
[2B] . Bohr emphasized that since all measurements must result in unambiguous results, one must 
necessarily use a classical measuring apparatus that is free from quantum mechanical uncertainties. 
The system and the apparatus enter into an ‘unanalyzable whole’ from which only statistically valid 
results can be inferred by a process that is left unspecihed. The questions that naturally arise are: 
(i) Where is the cut between the classical and the quantum domains? (ii) Can one be more specihc 
about the ‘unanalyzable whole’ ? These questions have engaged physicists and philosophers ever since 
in what appears to be an interminable debate. 

von Neumann 

If the quantum world is taken to underlie the classical world (all apparatuses, after all, are 
made of atoms and molecules which are known to behave quantum mechanically) and if quantum 
mechanics (as a physical theory) is to have universal validity, Bohr’s approach appears unsatisfactory. 
Furthermore, the dynamical evolutions of quantum and classical systems follow different laws, and 
hence there is no consistent way of coupling them, and therefore of using classical systems to measure 
quantum systems. These factors were taken into account by von Neumann [50] by treating the 
measuring apparatus quantum mechanically. This, however, resulted in an entangled or non-separable 
state p{S, A) of the system S and the apparatus A, and he had to introduce projection operators 
Ilj = \A)i{A\i (where \A)i are the complete set of hnal classical states of the apparatus) to reduce 
this pure state to a mixed state p{S,A) = njp(S', A)!!^ with Trp{SA) = Trp{SA) = 1 but 
p{SA)‘^ 7 ^ p{SA). The elements of this diagonal matrix represent the probabilities pi = |cip of 
the various measurement outcomes. A particular hnal state \A)i of the apparatus corresponds to 
a particular state \S)i of the system. Thus, ‘if this, then that’ is what can be said, and the hnal 
state is a product state |S')j|A)j with probability pi. This ‘conditional disjunction’ of an holistic state 
having coherence into distinguishable individuals lacking mutual coherence is non-unitary, and hence 
it must lie outside the domain of quantum mechanics, and consequently outside the domain of any 
physical theory if quantum mechanics is to have universal validity in the physical world. This process 
of measurement was dubbed ‘process 1’ by von Neumann. It is as mysterious as the Bohr process. 
He termed the unitary Schrodinger evolution of quantum systems ‘process 2’. It is ‘process 1’ that 
most interpretations have tried to avoid or eliminate. 

The Many-Worlds Interpretation 

In order to avoid ‘process 1’ Hugh Everett proposed the ‘relative state’ interpretation [21] which 
later on came to be transformed into the ‘many-worlds’ interpretation 152]. He achieved this by 
introducing a process of ‘splitting’ of the wave function into branches all of which exist simultaneously. 
This implies that all possible outcomes of a measurement actually exist simultaneously, and no 
collapse really takes place. This means that a cat is both alive and dead, but these two states are 
in different branches of the wave function which do not interact with each other. The main problem 
with this interpretation is that it is difficult to dehne probabilities in it [53]. Since all ‘possible’ 
outcomes actually occur, it appears meaningless to talk of probabilities for branches (other than 0 
and 1). Even if it does make sense to talk of nontrivial probabilities for branches, it is not clear what 
ensures that the probabilities in a many-worlds interpretation agree with those of standard quantum 
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mechanics [Ml 133] . Nevertheless, Aguirre and Tegmark [M] have proposed a cosmological version of 
the many-worlds interpretation. 

Hidden Variable Theories 

The EPR argument that quantum mechanics is incomplete spawned a variety of hidden variable 
theories whose aim was to complete quantum mechanics 1571. The basic idea was to introduce ‘hidden 
variables’ underlying the observables in such a way as to restore realism, and often also determinism, 
at the fundamental level, and yet recover the quantum mechanical predictions as averages over these 
hidden variables. However, most of these theories were subsequently shown to be incompatible 
with quantum mechanics (and hence really different theories) by certain no-go theorems, as we will 
shortly see, except the one proposed by Bohm (and earlier by de Broglie) [M]. In the de Broglie- 
Bohm theory, the position of a particle is introduced as an ontic hidden variable, and it is piloted 
by the wave function which is a solution of the Schrodinger equation. Once the distribution P(x, to) 
of particles is matched with the quantum mechanical distribution |'0(x,to)P at some intial time to, 
a continuity equation guarantees that it agrees with |'0(x,f)p at all future times t, ensuring that 
the ensemble averages of observables calculated from the distibution agree with the corresponding 
expectation values in quantum mechanics at all times. The theory is therefore completely equivalent 
to quantum mechanics in its observable predictions, but it restores realism (and also determinism) 
at the fundamental ontic level at the expense of locality. The theory is explicitly non-local because 
the position and motion of each particle generally depends on the coordinates of the whole system. 
In fact, Bohm often emphasized the non-locality or wholeness inherent in this interpretation as the 
only real signihcance of quantum physics vis-a-vis classical physics [58]. One would have expected 
Einstein to reject this interpretation on that ground alone, but strangely, he objected to it for its 
determinism. In a letter to Born dated 12 May, 1952 [59], he wrote: 

Have you noticed that Bohm believes (as de Broglie did, by the way, 25 tears ago) that 
he is able to interpret the quantum theory in deterministic terms? That way seems too 
cheap to me. But you, of course, can judge this better than I. 

A comprehensive account of the causal theory of Bohm will be found in the book by P. R. Holland 

[BU]. 

The matching of the probability distributions P{x,t) = \'ijj{x,t)\‘^, known as the quantum equilib¬ 
rium hypothesis, is a matter of some concern which has been addressed by Diirr and his colleagues 
[6T] and Valentini who has shown that superluminal signalling would be possible without this hy¬ 
pothesis [n2]- The matching at all times for entangled or non-separable particles turns out to be 
problematic [B21E1], requiring a specihc choice of the relative orientation of the conhguration spaces 
of the particles, which is not dictated by the theory itself. 

Initially, it was considered impossible to dehne boson trajectories in the de Broglie-Bohm theory 
in view of the difficulties of describing bosons relativistically [58]. During 1993-1996, Ghose and 
his colleagues developed a relativistic quantum mechanical description of spin-0 and spin-1 bosons 
starting from the Kemmer-Duffin-Petiau (KDP) equation [65] and the Harish-Chandra equation 
for massless bosons [66], laying the foundations for a de Broglie-Bohm theory of such bosons ing. 
They computed Bohmian trajectories of photons for specihc cases in 2001, using the Harish-Chandra 
equation [68] (Fig. 2). Subsequently in 2009, experiments by Steinberg and his colleagues [69] 
using techniques of weak measurements ITDl showed trajectories (Fig. 3) qualitatively similar to the 
predicted ones. However, weak measurements have been the subject of some controversy nn. 

Other Interpretations 
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Figure 2: Bohmian trajectories of photons calculated by Ghose, Majumdar, Guha and Sau (Ref. [55]1. 


There are some other interpretations of quantum mechanics such as the consistent histories in¬ 
terpretation [72], the transactional interpretation [TS], the modal interpretation m and relational 
quantum mechanics 1751, details of which will be found in [1]. The most recent interpretation is 
Quantum Bayesianism m which uses an informational or epistemic interpretation of the wave func¬ 
tion and views collapse as updating of information on obtaining new information, and hence not 
disturbing the ontic state in any manner. It is free of most of the paradoxes and conundrums of 
quantum theory. 


4 No-Go Theorems for Hidden Variables 

Some no-go theorems were proven later to show that most hidden variable theories were inconsistent 
with quantum mechanics, and hence presumably empirically false too. The hrst one of these was the 
von Neumann theorem. 

The von Neumann Theorem 

What von Neumann attempted was to prove that dispersion free states, i.e. hidden variables, were 
impossible. He hrst noted that any real linear combination of any two Hermitian operators represents 
an observable, and then made use of the further assumption that the same linear combination of 
expectation values was the expectation value of the combination. This assumption is certainly true 
of quantum mechanical states, but not of all dispersion free states, as was hrst shown by Bohm and 
later by Bell m- Alhough von Neumann’s assumption was applicable to a class of hidden variables, 
it was not applicable to hidden variables of the Bohm type which were ‘contextual’ in the sense 
that the observables in the theory were not properties of the observed system alone but also of the 
measuring apparatus. 

Other associated theorems like that of Jauch and Piron and of Gleason, and their limitations, 
will be found in Bell’s paper m- 
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Figure 3: Average trajectories of single photons observed in weak measurements by Steinberg and colleagues (Ref. 

m)- 


Bell’s Theorem 

Bell proved his famous theorem |19] in 1964, showing that quantum mechanics was incompatible 
with local realism. The readers will hnd an engaging review of Bell’s philosophy and work, particu¬ 
larly Bell’s theorem and its experimental verihcation, in Bertlmann’s recent paper [78]. It is worth 
noting that like Einstein, Bell too was disturbed by the non-locality implied by his theorem and its 
experimental conhrmation. As reported by Bertlmann, 

The nonlocality feature disturbed John deeply since for him it was equivalent to a ‘breaking 
of Lorentz invariance’ in an extended theory for QM, what he hardly could accept. He 
often remarked: ‘Its a great puzzle to me ... behind the scenes something is going faster 
than the speed of light. ’ 

For new perspectives on Bell’s theorem and non-locality, the reader is referred to the recent papers 
by Brown and Timpson na and Zukowski and Brukner [HQl El] • I will have occasion to return to 
this point later while discussing entanglement and the violation of Bell-like inequalities in classical 
optics. 

The Kochen-Speaker Theorem 

Unlike Bell who considered locality as a criterion, Kochen and Specker considered non-contextual 
hidden variables, i.e. variables that depend only on the quantum system being measured and not on 
the measuring device [H2|. This idea of non-contextuality is analogous to the classical notion that 
measurements only reveal values of pre-existing properties and do not depend on prior measurements 
of other compatible properties. Their theorem is based on two axioms: (i) value definiteness (i.e. all 
observables have dehnite values at all times) and (ii) non-contextuality (i.e. the value of an observable 
is independent of its measurement context). They showed that theories with such hidden variables 
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were incompatible with quantum mechanics when the dimension of the Hilbert space is three or 
more. Together with the previous ones, this theorem ruled out all hidden variable theories except 
those involving contextual and non-local hidden variables such as the de Broglie-Bohm theory. The 
original proof of the theorem is fairly complex, but a simplihed version for two spin 1/2 particles has 
been given by Mermin |83] and Peres |84j . 

The violation of the Kochen-Specker theorem has ben demonstrated in neutron self-interference 
experiments [55] . 

The Leggett-Garg Ineguality 

Leggett and Garg deduced a mathematical inequality that all macrorealistic physical theories 
must fulhl [86]. Macrorealistic theories are dehned by the conjunction of two postulates: 

(i) Macroscopic realism-. A macroscopic object, which has available to it two or more macroscop- 
ically distinct states, is at any given time in a dehnite one of those states. 

(ii) Noninvasive Measureability: It is possible in principle to determine which of these states the 
system is in without any effect on the state itself, or on the subsequent system dynamics. 

Quantum mechanical systems obviously violate this inequality on both counts, and the original 
motivation for this work was to propose a test for quantum coherence in macroscopic systems. Unlike 
the Bell theorem which tests entanglement between spatially separated systems, this inequality tests 
the correlations in a single system at different times. Violations of this inequality therefore test either 
the impossibility of a realistic description of the system or the impossibility of measuring the system 
without disturbing it. Recently a number of experimental tests have been performed on a variety 
of microscopic systems such as superconducting qubits, nuclear spins, and photons and violations of 
these inequalities have been observed [57] . 

5 Is the Wave Function Epistemic? 

The interpretation of a wave function in quantum mechanics, as we have seen, has been debated ever 
since its inception. While some have argued for an ontic (state of reality) interpretation, others have 
preferred an epistemic (state of knowledge) interpretation. Of late quantum information processing 
theory seems to be favouring the latter interpretation [551 EH] • An advantage of an epistemic inter¬ 
pretation is that a sudden change or collapse of the wave function is seen only as a Bayesian updating 
on receipt of new information. There is therefore no measurement problem and non-locality in this 
interpretation. 

However, Pusey, Barrett and Rudolph [50] have recently proved a no-go theorem with the help of a 
couple of reasonable assumptions (preparation independence) to rule out an epistemic interpretation. 
That was followed by Collbeck and Renner showing that if measurement settings can be chosen 
freely, a system’s wave function is in one-to-one correspondence with its elements of reality, thus 
ruling out any epistemic or subjective interpretation [91]. However, Lewis et al [92] have shown that 
an epistemic interpretation is possible if one drops the preparation independence assumption and also 
slightly weakens the dehnition of an epistemic state given by Harrigan and Spekkens [95]. Ghirardi 
and Romano [M] have criticized the assumptions of free choice and the completeness of quantum 
mechanics made by Gollbeck and Renner. The debate is therefore far from settled. The current 
situation has been reviewed by Leifer [95] . 

6 Wave Functions in Classical Physics 

Classical Mechanics 
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The fact that even Newtonian dynamics can be formulated in a Hilbert space spanned by square 
integrable functions but with a set of commuting hermitian operators as observables, has been known 
since the early 1930s, but only to a handful of physicists. I am referring to the classic works of Koop- 
man |2] and von Neumann [3] who developed a complete phase space theory of classical mechanics. 
The dynamics is Liouvillian. 

Though the classical Koopman-von Neumann (KvN) wave functions are complex, their relative 
phases are unobservable in classical mechanics. This is inherent in the way the KvN formalism is 
constructed. The basic idea of the Koopman theory [2] lay in the classical phase space description of 
statistical mechanics. For simplicity (but without loss of generality) let us consider a single-particle 
system described by a Hamiltonian H{p, q) in 2-dimensional classical phase space will commuting 
position and momentum variables (g,p) and the distribution function f{q,p;t). The distribution 
obeys the classical Liouville equation 


df{q,p;t) 

dt 


fdH d 
y dq dp 


dH d\ 
dp dq J 




-iLf{q,p;t) 


( 2 ) 


This was followed by von Neumann j3] and Koopman postulating that this dynamics can be viewed 
as arising from underlying classical square integrable wave functions 'ijj{q,p]t) in the Hilbert space of 
classical phase space variables obeying the equation 


d'ip{q,p; t) 
dt 


dH d dH d\ 


-iL'tp{q,p]t). 


(3) 


The complex conjugate wave function 'il:*{q,p;t) is postulated to obey the equation 


d'ip*{q,p;t) 

dt 


/dH d 
y dq dp 


dH d\ 
dp dq J 


'ip*{q,p;t) 


The scalar product in the Hilbert space is dehned by 


-iL'ip*{q,p]t). 


(4) 


(01V’) = / dpdq(j)*{q,p)'ilj{q,p), 


(5) 


and the integrability condition is given by 


poo /*oo 


dqdpii‘(q,p-,t)i>{q,p; t) = N. 


( 6 ) 


' —oo o —oo 


Using dimensionless variables and identihng the density in phase space by 

'ip*{q,p-t)'ip{q,p-t) = |0(g,p;t)|^ = p{q,P]t), (7) 

and using eqs. 0 and (|^, one can easily verify that the phase space density obeys the equation 

dp{q,p-,t) 


dt 


dH d dH d \ . . dp - 

-aqWp--^^) 


( 8 ) 


which is the Liouville equation. Thus, the Liouville equation can be derived from the postulated 
eqns. ([^ and (|^ for the classical wave function ip{q^p]t) and its complex conjugate, showing that 
the classical phase space probability density can be recovered from the dynamics of the underlying 
wave function and />*. Since only the probability density p{q,p;t) is observable in classical phase 
space, the phase of the wave function is not observable in this theory. This guarantees that no 
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interference effects occur with classical particles even though a complex wave function is associated 
with it. This can be made clearer by writing -0 = y^exp{iS) with S as the phase. Insering this 
expression in equations ([^ and Q and separating the real and imaginary parts, one gets 



lVp, 


LS, 


(9) 


showing that the amplitude and phase evolve independently. This results in a ‘superselection rule’, 
and it is possible to work with only ^/p. 

Position and momentum can be represented by self-adjoint and commuting operators [q,p] = 0 
which have continuous spectra from — oo to -|-oo. 


q\q,p) = q\q,p), p\q,p) = p\q,p), (10) 

where {\q,p)}, the set of simultaneous eigenstates of q and p, span the KvN Hilbert space, are 
orthonormal and form a complete set: 

{q\p\q,p") = Siq -q")5ip -i), (11) 

j j dqdp\q,p){q,p\ = 1. (12) 


Later Sudarshan [1] showed that it is also possible to view classical mechanics as a ‘hidden variable’ 
quantum theory with only the positive square root y/p = associated with the wave function 

its phase being unobservable. A supers election rule operates in this theory, making transitions 
between wave functions with different phases unobservable. In addition to the commuting position 
and momentum operators q and p, he introduced an additional pair of canonical operators x = 
and 77 = —idq (putting h = 1) in the Hilbert space with the properties 


[g,x] = 0, [g,7r]=i, (13) 

[P, = 0, [p, x] = -i. (14) 

The dynamical variables u = (g,p) and vr = (—tt, y) = may be considered as the canonical 
coordinates and momenta of a quantum system with two degrees of freedom. The equations of 
motion of the classical system can be viewed as the equations of motion of a quantum system with 
the Hamiltonian operator 


and have the form 


H 


= i 


,dH{u) d 


du^ du'' ’ 

^ ]PS 5 


U = —I 


u,H{u) = i{u H — H u) 


(15) 

(16) 


Since the Hamiltonian is linear in the quantum momenta tt = idt^, every phase space density p{u) is 
mapped into a new phase space density p{u) such that p{oj) = p{uj) where Cj are the displaced values 
obtained by solving Eqn. (16). In the Heisenberg picture the result is 




(17) 


Now, the quantum operators tt = are made unobservable at all times and under all conditions by 
imposing a superselection rule that renders only the commutative algebra of functions /(cj) of the 
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commuting dynamical varaibles u = [fliV) observable. This is a construction that embeds classical 
mechanics in a quantum theory with hidden variables. Since vectors in the Hilbert space of the 
quantum system are represented in the Schrodinger picture by wave functions ipioo), and because the 
relative phases of the ideal eigenstates of the coordinate operators are not measureable and therefore 
irrelevant, one has the equivalence 

~ (18) 

Hence, only the absolute value of is relevant and may be taken as the positive square root of 
the phase space density 

i){u) = ^/p{u) (19) 


A classical state represented by a point in phase space is identihed with an ideal joint eigenstate of 
the coordinate operators, and its time development is given by the solutions of equations (16) and 
([T^ describing an observable trajectory in phase space. It must be pointed out that the Hamiltonian 
operator H (eqn. 15) is not observable. What is observable is the Hamiltonian function H[(jj) which 
is a function of the observable coordinate operators u only. 

Since the overall phase of a state is not observable either in quantum mechanics or in classical 
optics, all states which differ only by a phase factor are usually identihed to get ‘projective rays’, 
resulting in the space CP = H/U{1) of rays. The Bloch sphere in quantum mechanics and the 
Poincare sphere in classical polarization optics are examples. However, relative phases are observable 
in both quantum mechanics and classical optics, though not in classical mechanics. Hence, to rule out 
interference effects in classical mechanics, a further projection or identihcation is required, namely, 
all states that differ by relative phases are also identihed. This results in the quotient space CP* = 
CP/U{1) which implements the required supers election rule. 

As an example of this method of treating classical mechanics as quantum mechanics with a hidden 
variable, let us consider the Hamiltonian operator of a free particle. 




p% 

m 


The Heisenberg equations of motion are 


p = 


H,p 


= 0 , 


TT = 0, 

X = 


( 20 ) 


( 21 ) 


The equations of motion for the observable dynamical variables {q,p) are identical to Hamilton’s 
equations, but the dynamical variables (y, tt) are not observables. We will see later how this quantum 
mechanical treatment of a classical system can be used to deal with the case when it interacts with 
a quantum mechanical system. 

The theory has been developed further since 1998 by a number of authors [96l [971 EH [99l 11001 
1101111021110311104111051110611107111081110911110] . They introduce the additional operators = —idg 
and Xp = —idp which can be identihed with the operators tt and — y respectively. To go from the 
{q,p) representation to the (g, Xp) representation with 

q\qi Xp) = q\q, Xp), Xp\q, Xp) = Xp\q, Xp), (22) 
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the required unitary transformation equations are IMl 


SO that 


Hence, 


or equivalently, 



i-^{q\p\qAp) = Ap(g',p'|g, Xp) 


{q,p\q,Xp) = -^6{q-q')exp (^ip \p^ . 


dqdp{q,Xp\q,p){q,p\ij) = ^= / dpexp (ipXp) {q,p\^p), 


^{q,Xp,t) = 




dp exp {ipXp)'il){q,p,t),. 


(23) 

(24) 

(25) 


(26) 


For a particle of unit mass in a potential V the Liouville equation for the classical wave function in 
this representation is 

^ / o o \ 

Xp, t) = - y\q)Xpj 'ipiq, Xp, t) (27) 

and its complex conjugate is 


d 

i-^^*iqAp,t) 

It follows from these equations that 

d 

-Q^PKqAp.t) 


J{qy Xp, t) 


(d d 
\dq dXp 



'ip*{q,Xp,t). 


J{,q-i Xp, t), 

^ / 9 d 


(28) 


(29) 


Writing 


'/'(?, \,i) = dpill, V. t) expiS)?. A,, t), 


(30) 


one sees that the time derivative of the density is connected with the wave function, unlike in the 
(q,p) representation (see eqn. |^, and hence, phase features are present in this representation though 
not in the {q,p) representation. However, these phase features remain unobservable because of the 
superselection rule. 


Classical Electrodynamics 


A fundamental difference between classical particles and classical waves (like electromagnetic 
waves) is that interference effects are observable in the latter. Hence, it should be possible to develop 
a phase space theory of such helds by using a projective Hilbert space CP so that no superselection 
rule operates, and this has been done by Rajagopal and Ghose [22] • The classical ‘wave function’ of 
the electromagnetic held can be written as a six-component column vector 




( E, \ 

Ey 

E, 

-Bx 

-By 

\-bJ 


( 31 ) 
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and its dual 'ip^{Ei,Bi) = (^E*,E*,El,—B*,—B*,—Biy Denoting by ip the complex dynamical 
variables {Bi,Ei}, one can define inner products 

( 01 V’) = J IldEiU,dBj6{E.B){<P\Ei,Bi){Ei,Bi\7p) = j ( 32 ) 


where dip = IlidEiIljdBjS{E.B) and the scalar product is given by 

Il'i/’IP = {'I’M = J M'l’Hfl'I’if) = j Mpif) (33) 

with p(y,) = + B’Bt) (i = x,y,z). Normalized by the total energy, this 

gives the probability density in phase space if one treats the magnetic fields {Bi} as the cordinates 
and the electric fields {Ei} as the conjugate momenta such that E.B = 0. Using units in which 
^0 = ho = c = 1, let the equations of motion for the wave functions be 

= -iLij{ip,t) = ~^^idiij{ip,t), (34) 

i 

=-^di'il){ip,t)^l3i, (35) 


where di = d/dxi and L = —is the Liouvillian operator and fd] = jdi are three 6 x 6 
hermitian matrices (whose explicit forms are given in the Appendix) such that the equations (34) 
and (35) encode the Maxwell equations 

E = curl 5, B = —curlU. (36) 


Multiplying the first equation by 0 ( 9 ?, t)i from the left and the second equation by 'ijj{ip,t) from the 
right and adding them, one gets the continuity equation 


dt 

Si{ip,t) 


-2iil){ip,t)^ Lil){ip,t) = - ^^diSi{ip,t), 

i 


(37) 


Given the forms of the fd matrices Si = {E x B)i turn out to be components of the Poynting vector. 
This is the Liouville equation for the phase density which is different from the equations of motion 
of the underlying wave functions. It is clear from this that the time derivative of the phase space 
density and amplitude 0 are coupled, and the relative phase is an observable unlike in the KvNS 
theory of classical mechanics. 

As in classical mechanics, it is possible to embed classical electrodynamics also in a quantum 
field theory by doubling the number of variables, the additional variables being hidden variables. Let 
Xi = -\Ei = ids,, Xi = -Xe* = idE*, = Xb, = and fr* = Xb* = -ids* {d now denoting 

functional partial derivatives) be these hidden canonical variables with the commutation properties 


Idi{x),Xj{x') 

Ei{x),Tlj{x') 

'B:{x),rj{x) 

E*{x), 71 *{x') 


0 , 

0 , 

0 , 

0 , 


Bi{x),7rj{x') 

Ei{x),Xkix') 

B*{x), 7 i*{x') 

Ei{x)'Xl{x) 


= i5^{x — x'), 

= —iS^{x — x'), 
= i6^{x — x'), 

= —i6^{x — x). 


(38) 
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The conventional classical representation corresponds to the choice (p = {B, E) as the complete set 
of observable dynamical variables with Bi as the cordinates and Ei as the momenta and 


Ei, Bj 


= 0 , 


e:,b* 


= 0 V*,j = 1,2,3. 


(39) 


Other quantized representations can also be used by choosing a pair of commuting variables from 
If and If = (x, tt) = id^ as the coordinates and momenta. For example, one can make a unitary 
transformation from the commuting variables p = {B, E) to the commuting variables ^ = {B, \e = 
—x) with the properties 


Bi\B, Xe) — Bi\B, Xe), XEi\B, Xe) — XEi\B, Xe) 
and the transformation equation 

1 


{B,E\B,Xe) = 


(27r)3/2 




and 


j d^Eexpii'^EiXEA'ip{p,t). 


The Liouville equations for this classical wave function and its adjoint are 




^_ d_ 

dB* dXEi 
d d 


dB*dXE„ 

Dehning t), it follows that 

d 


-B*XE^j^/Ji^,t), 


J(e,t) = i (ij* of fr.* of 


dB* OXe, ^ dB* dXE, 


If one writes in the form 


= VpK.«)exp!S(B;,AE,,(), 


(40) 

(41) 

(42) 

(43) 

(44) 

(45) 

(46) 

(47) 


it becomes clear that the time derivatives of the density and amplitude get connected, showing that 
phase features are preserved in the {B, Xe) representation of the electromagnetic field. Alternatively, 
one could choose (A^ = '^,E) as the commuting set. Both of these representations are examples of 
embedding classical electrodynamics in a quantum field theory with hidden variables. The difference 
from classical mechanics is that there is no supers election rule in electrodynamics making relative 
phases between different states unobservable, and hence superpositions of states can be written in 
electrodynamics. 

In the full operator formalism the equations of motion in the Schrodinger picture takes the form 

^4(4,4 = (48) 
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which are the Maxwell equations 


E = curl 5, B = —curl^. 

in the operator form, and 

i 

which are the equations of motion for the hidden variables If = {x, tt) 

X = curl7r, 7r = —curlx- (51) 

An extremely important development in this field is the interpretation of the Wigner function as 
a KvNS wave function, i.e. as a probability amplitude that need not be positive everywhere |23l[2l]. 
The significance of the Wigner function so far has been that it mimics the classical distribution func¬ 
tion, which is positive everywhere, but with characteristic quantum features imbedded in it, namely 
that it is not positive everywhere, the quantumness being conventionally attributed to its negative 
features. Bondar and his coworkers have given it a new interpretation as a wave function and hence 
as a ‘a probability amplitude for the quantum particle to be at a certain point of the classical phase 
space’. This dissolves the ‘mystery’ of the negativity of the Wigner function. According to this inter¬ 
pretation the essential quantumness of a process lies not in the negativity of the Wigner function but 
in the distinctiveness of quantum processes to make transitions from positivity to nonpositivity and 
vice versa while classical processes are only negativity and positivity preserving. Hence, negativity 
and positivity preserving quantum processes can be simulated by classical polarization optics. 

7 Entanglement and Non-locality 

Entanglement and Bell violations have hitherto been exclusively associated with quantum phenomena 
and non-locality, and so it might at first sight appear absurd to claim that they occur in the very 
bastion of classical physics, namely classical optics, and that they do not imply non-locality. This 
is understandable because generations of physicists have been brought up on the myth that Hilbert 
spaces occur only in quantum physics, and that violations of Bell inequalities occur only in quantum 
phenomena and imply non-locality. The fact is that Hilbert spaces and the Schmidt decomposition 
were known in classical physics before quantum mechanics was even born m- Furthermore, and this 
is a subtle point that needs to be emphasized, apart from realism, ‘separability ’ of states in different 
Hilbert spaces is sufficient for CHSH-type inequalities, and it is not necessary to assume locality, as 
Bell did. Einstein was aware of the difference between separability and locality, and that is clear from 
his ‘Autobiographical Notes ’ m- He considers two spatially separated and non-interacting partial 
systems Si and S 2 described by an entangled wave function fj. When a measurement is made in 
either of two mutually incompatible bases on Si, two different wave functions for S 2 result, as we 
have seen in Section 2. According to Einstein, 

Now it appears to me that one may speak of the real factual situation of the partial system 
S 2 - Of this real factual situation, we know to begin with, before the measurement of Si, 
even less than we know of a system described by the -^-function. But, on one supposition 
we should, in my opinion, absolutely hold fast: the real factual situation of the system 
S 2 is independent of what is done with the system Si, which is spatially separated from 
the former. 


(49) 

(50) 
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Since a unique wave function cannot be associated with the ‘real factual situation’ of S' 2 , the quantum 
mechanical description of the system is incomplete. Einstein then continues to say: 

One can escape from this conclusion only by either assuming that the measurement of 
Si (telepathetically) changes the real factual situation of S '2 or by denying independent 
real situations as such to things which are spatially separated from each other. Both 
alternatives appear to me entirely unaceeptable. 

Einstein is clearly setting out the ontic view of the systems and their unique quantum mechanical 
wave functions to show that such a view leads to an incomplete description of reality unless one 
admits either telepathy or non-separability. He clearly distinguishes between ‘telepathy’ (i.e. action- 
at-a-distance between independent and non-interacting systems) and ‘denial of independence’ to 
even spatially separated non-interacting systems (non-separability), something he could not do in 
the single-particle case (see Section 2). He, however, rejects both. In his time nobody was aware 
that the spatial and polarization modes of a single beam of classical light, which belong to different 
and independent Hilbert spaces, could become ‘non-separable’. There is obviously no question of any 
‘non-locality’ in such cases. Hence, we can say today, thanks to recent developments in classical optics, 
that Bell-CHSH-like violations are not sure tests of either quantumness or non-locality. What the 
Bell theorem does show is that only non-separable states violate Bell-like inequalities, not separable 
or product states, and that too for very special apparatus settings only. This is true in both classical 
polarization optics and quantum physics. 

There is, however, one clear difference between classical optics and quantum mechanics coupled 
with the projection postulate (von Neumann’s ‘process 1’) which would require that a strong projec¬ 
tive measurement on the partial system Si in either basis would result in one of the two terms on 
the right-hand sides of Eqn. ([^ disappearing instantly in every measurement. This does not happen 
in either classical optics or in interpretations of quantum mechanics that do not invoke von Neu¬ 
mann’s ‘process 1’ (or collapse) such as the Everett interpretation. Clearly therefore a real factual 
change of the ontic state of S '2 can be inferred only provided a strong projective measurement does 
occur as a result of a measurement on a distant non-interacting partial system Si. This putative 
process is precisely the one that many interpretations of quantum mechanics avoid, as we have seen. 
Alternatively, one must admit that two (or more) wave functions can describe the same ontic state 
of the system S 2 . The hrst alternative implies non-locality whereas the second alternative implies 
that quantum mechanical wave functions are epistemic (i.e. states of knowledge) and provide an 
incomplete description of nature. Einstein was in favour of the latter view [13]. As we have seen, 
there is much current interest in this area of quantum physics [H]. Classical KvNS wave functions 
can be ontic in spite of CHSH-like violations because there is no collapse in classical measurements. 

8 Realism and Non-contextuality 

What about realism? Classical realism is associated with non-contextuality, i.e. the notion that a 
physical property is independent of the context in which it is measured. In other words, a measure¬ 
ment result is predetermined and is not affected by whether previous or simultaneous measurement 
of any other compatible or co-measureable observable is carried out on the system or not. In classical 
physics all observables are, of course, compatible. This is why local realistic classical theories have 
been presumed to be non-contextual because the result of a measurement in such theories does not 
depend on any measurement made simultaneously on a spatially separated (mutually non-interacting) 
system. This concept can be tested by joint measurements of compatible observables that are not 
necessarily spatially separated such as the spatial and polarization modes of a single beam of classical 
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light—a change of the polarization (spatial) mode of a separable light beam should not change or 
affect its spatial (polarization) mode, showing that such a beam is non-contextual, but this should 
not be true of an entangled beam. It should be fairly easy to test this by using Laguerre-Gaussian 
modes. It should also be possible to test the violation of a CHSH-type inequality that can be deduced 
by assuming separability, as well as the Kochen-Spekker theorem |18j . 

This renders the classical concept of reality problematic—one has to admit that reality can be 
contextual in certain cases even in classical physics! 


9 Waves, Particles and Quantum Measurement 


We have seen that complex wave functions alone do not distinguish quantum physics from classical 
physics. The fundamental difference lies in the commutation properties of the observable dynamical 
variables and the dynamical evolution equations. In classical physics the evolution equation is the 
Liouville equation 

^ = -iLp^ (52) 

where pc is the classical density in phase space and L is the Liouville operator. In quantum physics 
the corresponding evolution equation is the Moyal equation for the Wigner function. 


dW{q,p,t) 

dt 


= -{{W{q,p,t),H{q,p)}} 


(53) 


where W{q,p,t) is the Wigner function, H{q,p) is the Hamiltonian and {{W{q, p,t), H{q, p)}} is 
their Moyal bracket. In the limit h ^ 0 the Moyal bracket reduces to the Poisson bracket, and the 
Moyal equation for the Wigner function reduces to the classical Liouville equation (52). We have 


already seen (in the last paragraph of Section 6) that the Wigner function is, in fact, a probability 
amplitude for a quantum particle to be at a certain point of the classical phase space, and that 
in the classical limit it transforms into a classical KvNS wave function rather than into a classical 
probability distribution pc- The reader would recall that in the {q,p) representation of the KvNS 
theory, the wave function, in fact, obeys the same Liouville equation as the density pc (Eqns (§, (§ 
and (|^) and its phase is unobservable. 

This brings us back to wave-particle duality which is widely believed to be the most typical 
example of a quantum paradox. It is not so well known that classical physics also has a conceptually 
dual character, as Einstein pointed out in his ‘Autobiographical Notes • m in which he writes. 


■ ■ ■ there exist two types of conceptual elements, on the one hand, material points with 
forces at a distance between them, and, on the other hand, the continuous held. It rep¬ 
resents an intermediate state in physics without a uniform basis for the entirety, which— 
although unsatisfactory—is far from having been superseded. 


It is widely held that this dual character is resolved in quantum held theory in which ‘particles’ 
appear as quantized excitations of a continous held. 

It should be clear from the above discussion that the KvNS theory of classical physics already 
provides the underlying unity of waves and particles that Einstein referred to as the ‘uniform basis 
for the entirety’. We have seen in Section 6 that a supers election rule operates in the KvNS theory 
which renders the relative phases between complex classical wave functions unobservable, ensuring 
particle-like trajectories in phase space, and that the corresponding Hilbert space is CP* = CP/U{1). 
Such a superselection rule, however, does not operate in the CP Hilbert space spanned by the wave 
functions of the classical electromagnetic held. Leaving aside the case of the electromagnetic held 
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(whose quantized version is quantum field theory), one is entitled to ask: what happens in the non- 
relativistic quantum mechanical case where the relative phases of the wave function are observable? 
There is no particle aspect of such a wave function until a detection occurs when the wave function 
appears to collapse into a single point, a ‘particle’. 

In quantum mechanics the dynamical variables form a non-commuting algebra so that not all 
dynamical variables can be measured simultaneously with precision. However, every measurement 
selects a commuting subalgebra of dynamical variables which are compatible and can be measured 
simultaneously with precision. So, the measurement process is such that it produces classical pointer 
readings and unambiguous measurements of a compatible set of dynamical variables. Hence, as 
Bohr emphasized, quantum theory presupposes classical systems which can be influenced by quantum 
systems. This is possible if the quantum system and the classical system comprising the apparatus 
can be coupled. However, as we have seen, the dynamical equations for classical and quantum systems 
are different. It is precisely this point, largely glossed over, that is addressed by Sudarshan’s approach 
12 [na Ea na ES]. As we have seen, he proposed that the KvNS formalism can be looked upon 
as an embedding of the classical system in a quantum system with a continuum of superselection 
sectors. In other words, it is possible to look upon classical mechanics as quantum mechanics with 
essentially hidden variables. These are not the usual dynamical variables, but they are canonical, and 
hence they can be considered as dynamical variables. The equation of motion for the set of dynamical 


variables is given by equation (16) which has the same form as the quantum mechanical equation of 


motion. This makes it possible to couple a quantum system to a classical system consistently. 
Now consider a quantum mechanical harmonic oscillator with the Hamiltonian 


Hn = 


2 


(54) 


and the measurement of its momentum p by the coupling term gpx^ to a classical measuring appa¬ 
ratus A with the Hamiltonian operator 


frA 


(55) 


which is a quantum mechanical system with hidden variables and a superselection rule (see equation 

(56) 


(20)). Then the total Hamiltonian is 


H = Ho + H^ + gpr, 


and the equations of motion are 


q = 


P 

— + gx , 

m 

. 2 ; 


p = mu q, 
i^A 


r = 0 , 


p = 


X''"' , - 


(57) 

(58) 

(59) 

(60) 


The position of the oscillator cannot be measured because the Hamiltonian H and q contain the un¬ 
observable x^. This is consistent with Bohr’s position that that there is an uncontrollable disturbance 
in the conjugate variable q when p is being measured. On the other hand, the equation of motion 
for p"^ contains a term proportional to p and is an observable. Sudarshan has shown generally that 
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the theory naturally leads to a measurement via the trajectory of only a commuting set of quantum 
dynamical variables. 

Another example is the Stern-Gerlach experiment to measure the spin of a neutral particle. In 
this case the Hamiltonian operator is 

H = -—p.q-iTS^^-')B^S^ (61) 

m ops 

where F is proportional to the magnetic held gradient. The equations of motion can be soved to give 

qi{t) = —Pit, q 2 {t) = 0, (62) 

m 

q^{t) = (63) 

with the spin taken as ±|. This gives two parabolas for the trajectory. 

As we have seen earlier, the superselection rule implies that one cannot write linear superpositions 
of classical KvNS states, and that their density matrix is mixed. The result of the coupling between 
the quantum system and the classical measuring apparatus is obviously therefore a mixed state 

P = (64) 

i 

where |<hj) = \q)i^\u))i with \q)i a quantum state and \uj)i its correlated classical state. This is, indeed, 
the result that one would obtain by using quantum wave functions for the measuring apparatus and 
invoking von Numann’s ‘process 1’ (the collapse postulate). Hence, the KvNS theory for the classical 
apparatus is sufficient to lead to the standard quantum mechanical results without requiring collapse 
of the quantum state. 

The superposition principle is fundamental to quantum mechanics and is a consequence of its 
linearity. It is reponsible for interference phenomena, famously exemplihed by the double-slit experi¬ 
ment. These interference effects can in certain situations get suppressed (sometimes spontaneously), 
and the quantum systems are said to decohere. The theory of decoherence is the study of interac¬ 
tions between a quantum system and its environment (usually modelled by a heat bath) that lead to 
such suppression of interference |116l I117j . The coupling of a measuring apparatus (treated quantum 
mechanically) to its environment would accordingly cause its rapid decoherence, resulting in a mixed 
state. 

Decoherence is usually regarded as being relevant to a variety of questions ranging from the 
measurement problem to irreversibility, and most importantly to the emergence of the classical world 
from a quantum substratum |118[ I119j . It was originally claimed that decoherence also solves the 
measurement problem, but this claim has been refuted |12ni 1121] . The reader may hnd Ref. |122] a 
useful review article on decoherence. 

Mixed states in the KvNS theory of classical mechanics are analogous to mixed states after deco¬ 
herence in quantum mechanics, but have their origin in ‘hidden dynamical variables’ or unobservable 
relative phases resulting from a superselection rule. Sudarshan’s use of this (so far largely ignored) 
mechanism for decoherence of classical mechanical systems in solving the quantum measurement 
problem brings about a new harmony of waves and particles in quantum mechanics. 

10 Concluding Remarks 

We began with a very brief review of the principal paradoxes of quantum theory leading to various 
interpretations of quantum mechanics as well as to the principal no-go theorems that have ruled out 
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all hidden variable theories except those that are contextual and non-local such as the de Broglie- 
Bohm theory. We have seen how the nature of the quantum wave function, i.e. whether it is ontic 
or epistemic, has been the subject of a long debate which still continues. 

We have also seen how the concepts of waves and particles with all their subtleties and dichotomies 
have evolved since the inception of quantum theory, and also the principal attempts to harmonize 
them. Bohr viewed them as mutually exclusive but complementary aspects of a quantum entity 
whereas Einstein, de Broglie and Bohm preferred a more inclusive harmony. Some single photon 
experiments like the double prism experiment as well as the observation of predicted single photon 
trajectories in a double slit interference experiment using weak measurements lend considerable 
support to, though not conclusive proofs of, the latter view. It was Koopman and von Neumann who 
realized that complex wave functions spanning Hilbert spaces are not unique to quantum mechanics. 
They formulated classical mechanics in a manner analogous to quantum mechanics by using square 
integrable complex wave functions underlying the distribution function p(g, p) in classical phase space 
of particle trajectories, and representing the associated physical observables by means of commuting 
self-adjoint operators, thus providing a clear and beautiful harmony of waves and particles. In 
their formulation, a supers election rule operates to make the relative phases of the wave functions 
unobservable. Sudarshan then showed how classical mechanics can be considered as a quantum 
theory with hidden variables. This necessitates a doubling of the dynamical variables with only two 
of them observable and the other two hidden. A useful way of looking at the supers election rule is 
to view it as a quotient map CP —)■ CP/U{1). We have also seen how the KvNS theory can be 
extended to classical electrodynamics in a CP Hilbert space in which relative phases are observable. 
This provides a sound foundation to classical electrodynamics that satisfactorily accounts for the 
entanglement/non-separability and CHSH-like violations already observed in classical polarization 
optics. Although the classical KvNS wave function is certainly ontic, surprisingly it can be contextual 
in certain cases, rendering the concept of classical realism problematic. 

One of the important new insights that have been obtained through these developments is that 
entanglement and CHSH-like violations are neither unique signatures of quantumness nor of non¬ 
locality —they only signify an underlying Hilbert space structure and non-separability. There is 
a signihcant distinction between non-locality and non-separability, and what CHSH-like violations 
have shown is the latter, not necessarily the former. To establish non-locality in quantum physics, 
one must hrst establish the ontic character of collapse, which has not been done as yet. 

Another extremely important insight is the interpretation of the Wigner function as a KvNS 
wave function, i.e. a probability amplitude which need not be positive everywhere [231121] • This 
has important implications for simulating certain types of quantum information processes by using 
classical polarization optics. 

The KvNS theory seems to suggest that classical physics emerges from a quantum substratum 
when the non-commuting dynamical variables somehow become hidden. 
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Note added 

My attention has just been drawn to the paper arxiv: 0501.03202 [quant-ph] by Jennings and 
heifer dated 13th January, 2015. There is no reference to the developments in classical polarization 
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optics related to entanglement and Bell-CHSH-like violations (Refs. 10-22) in this paper. 


12 Appendix 

The matrices /?, are given by 
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